Stability AI has once again broken through technical barriers by launching the new Stable Diffusion 3.5 Medium model. This AI art tool aimed at the general public is not only completely free for commercial use but also achieves a perfect balance between high performance and accessibility. With its multimodal diffusion transformer (MMDiT-X) architecture and a streamlined design of 2.5 billion parameters, this model cleverly addresses the hardware threshold for ordinary users, requiring only 9.9GB of VRAM to run smoothly on most consumer-grade graphics cards.

Last night, Stability AI unveiled its most powerful model - Stable Diffusion 3.5, which is not just a single model, but a package containing three versions, designed to meet the diverse needs of researchers, business enthusiasts, startups, and enterprises. The three versions are Stable Diffusion 3.5 Large, Stable Diffusion 3.5 Large Turbo, and one that will be available on October 29.

The Stable Diffusion 3 model introduces the DiT (Diffusion Transformer) architecture, which significantly improves quality. Stable Diffusion 3 outperforms other text-to-image generation systems. The parameter count of Stable Diffusion 3 ranges from 800M to 8B. The SD3 architecture is developed in collaboration with core members of Sora and an assistant professor from New York University.

The technical report on Stable Diffusion 3 reveals that SD3 adopts the Multimodal Diffusion Transformer architecture MMDiT. SD3 introduces reweighted flow technology to enhance performance. The report discusses the scaling research of SD3 and anticipates future performance improvements along with issues and suggestions regarding the text encoder.

Stable Diffusion 3 is the most powerful text-to-image model. It adopts the MMDiT architecture, demonstrating performance that surpasses existing text-to-image generation systems. Stable Diffusion 3 excels in visual aesthetics, text adherence, and layout compared to other advanced models. The MMDiT architecture combines DiT and rectangular flow forms, processing image and language representations through independent weight sets. Stable Diffusion 3 offers flexibility.